Modified Levenberg-Marquardt Method for Neural Networks Training
نویسنده
چکیده
In this paper a modification on Levenberg-Marquardt algorithm for MLP neural network learning is proposed. The proposed algorithm has good convergence. This method reduces the amount of oscillation in learning procedure. An example is given to show usefulness of this method. Finally a simulation verifies the results of proposed method. Keywords—Levenberg-Marquardt, modification, neural network, variable learning rate.
منابع مشابه
An Algorithm for Fast Convergence in Training Neural Networks
In this work, two modifications on Levenberg-Marquardt algorithm for feedforward neural networks are studied. One modification is made on performance index, while the other one is on calculating gradient information. The modified algorithm gives a better convergence rate compared to the standard Levenberg-Marquard (LM) method and is less computationally intensive and requires less memory. The p...
متن کاملApplying Bacterial Memetic Algorithm for Training Feedforward and Fuzzy Flip-Flop based Neural Networks
In our previous work we proposed some extensions of the Levenberg-Marquardt algorithm; the Bacterial Memetic Algorithm and the Bacterial Memetic Algorithm with Modified Operator Execution Order for fuzzy rule base extraction from inputoutput data. Furthermore, we have investigated fuzzy flip-flop based feedforward neural networks. In this paper we introduce the adaptation of the Bacterial Memet...
متن کاملTraining recurrent network with block-diagonal approximated Levenberg-Marquardt algorithm
In this paper, we propose the block-diagonal matrix to approximate the Hessian matrix in the Levenberg Mar-quardt method in the training of neural networks. Two weight updating strategies, namely asynchronous and synchronous updating methods were investigated. Asyn-chronous method updates weights of one block at a time while synchronous method updates all weights at the same time. Variations of...
متن کاملPredictive Abilities of Bayesian Regularization and Levenberg–Marquardt Algorithms in Artificial Neural Networks: A Comparative Empirical Study on Social Data
The objective of this study is to compare the predictive ability of Bayesian regularization with Levenberg–Marquardt Artificial Neural Networks. To examine the best architecture of neural networks, the model was tested with one-, two-, three-, four-, and five-neuron architectures, respectively. MATLAB (2011a) was used for analyzing the Bayesian regularization and Levenberg–Marquardt learning al...
متن کاملPerformance Evaluation of Various Back-propagation Training Algorithms in the Neural Network Based Classification of Respiratory Signals
In this work, we describe a method for the classification of respiratory states based on four significant features using Artificial neural network (ANN). These features are extracted from the respiratory signals using modified threshold algorithm were fed as input parameters to the ANN for classification. A gradient based search algorithms are usually being used in ANN to find a set of suitable...
متن کامل